Language learning with interactive virtual agent scenarios and speech recognition: Lessons learned

نویسندگان

  • James N. Anderson
  • Nancie Gunson
  • Hazel Morton
  • Mervyn A. Jack
چکیده

The SPELL (Spoken Electronic Language Learning) system is a self-access computer-assisted language learning (CALL) package that integrates speaker-independent continuous speech recognition technology with virtual worlds and embodied virtual agents to create an environment in which learners can converse in the target language within meaningful contextualized scenarios. In this paper we provide an overview of the functionality, architecture, and implementation of the SPELL system. We also describe four phases of usability evaluation conductedwith the system and summarize the main results of these user assessments. Finally, we discuss the most significant lessons learned in the development and evaluation of the system. The paper focuses on the technological aspects of the system and its evaluation for usability and robustness, rather than its pedagogical methodology. Copyright # 2008 John Wiley & Sons, Ltd.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

EmoEmma: Emotional Speech Input for Interactive Storytelling (Demo Paper)

Whilst techniques for narrative generation and agent behaviour have made significant progress in recent years, natural language processing remains a bottleneck hampering the scalability of Interactive Storytelling systems. This demonstrator introduces a novel interaction technique based solely on emotional speech recognition. It allows the user to use speech to interact with virtual actors with...

متن کامل

EmoEmma: emotional speech input for interactive storytelling

Whilst techniques for narrative generation and agent behaviour have made significant progress in recent years, natural language processing remains a bottleneck hampering the scalability of Interactive Storytelling systems. This demonstrator introduces a novel interaction technique based solely on emotional speech recognition. It allows the user to use speech to interact with virtual actors with...

متن کامل

The More the Merrier: Multi-Party Negotiation with Virtual Humans

The goal of the Virtual Humans Project at the University of Southern California’s Institute for Creative Technologies is to enrich virtual training environments with virtual humans – autonomous agents that support face-to-face interaction with trainees in a variety of roles – through bringing together many different areas of research including speech recognition, natural language understanding,...

متن کامل

Attitudes towards Subtitles and their Effect on User Responses in Speech Interactive Foreign Language Learning

The use of subtitles in a Computer Assisted Language Learning (CALL) program can assist learners in the comprehension of the language input they are exposed to. In an interactive CALL program, subtitles may also help learners in the formulation of their own responses. This paper describes the evaluation of a speech interactive CALL program that combines speech recognition technology, embodied a...

متن کامل

A New Method for Speech Enhancement Based on Incoherent Model Learning in Wavelet Transform Domain

Quality of speech signal significantly reduces in the presence of environmental noise signals and leads to the imperfect performance of hearing aid devices, automatic speech recognition systems, and mobile phones. In this paper, the single channel speech enhancement of the corrupted signals by the additive noise signals is considered. A dictionary-based algorithm is proposed to train the speech...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Journal of Visualization and Computer Animation

دوره 19  شماره 

صفحات  -

تاریخ انتشار 2008